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ABSTRACT 

In order to provide a high-resolution underwater-ranging capability for scientific 
measurement, a commercially available optical-ranging system is analyzed for performance 
and feasibility. The system employs a structured-lighting technique using a laser-light plane 
and single-camera imaging system. The mechanics of determining range with such a system 
are presented along with predicted range error. Controlled testing of the system is performed 
and range error is empirically determined. The system is employed in a deep-sea application, 
and its performance is evaluated. The measurements obtained are used for a scientific 
application to determine seafloor roughness for very-high-spatial frequencies (greater than 1 0 
cycles/meter). Use and application recommendations for the system are presented. 



Thesis Supervisor: W. Kenneth Stewart, Jr. 
Woods Hole Oceanographic Institution 



2 



Acknowledgements 



I would like to make special mention of those without whose assistance this thesis 
would not have been possible and give my gratitude to the following; 

• My thesis advisor, Ken Stewart, whose unbelievable patience and faith went above 
and beyond any previous records set. 

• The Deep Submergence Lab's Engineering Team, whose skill and at-sea expertise 
made a major portion of this work possible. I would like to especially thank Andy 
Bowen and Bob Elder. 

• The Crest '91 ROV Pilots, Will Sellers, Dave Lavolvo, and Skip Gleason, whose 
incredible skill and adept abilities made the close-range laser surveys possible. Their 
special consideration during Crest '91 is greatly appreciated. 

• The Crest '91 Chief Scientists, John Delaney and Bob Ballard, for the priceless 
bottom time needed. 

• My officemates, Tad Snow and Hanumant Singh, for always offering a listening ear 
no matter how bad the idea may have been and their valuable advice. 

• The Sysjan, Marty Marra, for my innumerable interruptions and his forbearance in 
always answering the question, 'How do I?' 

• The local expert, Jon Howland, for his time, experience, and dedicated interest. 

• The U.S. Navy and Oceanographer of the Navy for their sponsorship and this 
incredible opportunity to work in this field and perform uninhibited research. 



Lastly, a special thanks to my parents, John and Marie, who always said the 
right things and gave me the encouragement to succeed and, above all else, to my 
wife, HollyAnn, for continuing in that tradition and providing me with her ever loving 
support. 



3 



Contents 



ABSTRACT 2 

Chapter 1 INTRODUCTION 1 1 

1 . 1 Background II 

1.2 Objectives 12 

1.3 Overview 12 

Chapter 2 HIGH-RESOLUTION UNDERWATER RANGING 14 

2.1 High-Resolution Sonar 14 

2.2 Underwater Optical Ranging 16 

2.2.1 Underwater Optics 16 

2.2.2 Underwater Photogrammetry 18 

2.2.3 Laser-Ranging Systems 18 

2.2.3. 1 Laser-Radar Systems (LIDAR) 19 

2. 2. 3. 2 Ajnplitude-Modulated Ranging Systems 20 

2. 2. 3. 3 Structured-Lighting Techniques 22 

Chapter 3 LASER-PLANE STRUCTURED LIGHTING 23 

3.1 Laser-Line Determination 23 

3.2 Laser-Camera Geometry 27 

3.3 Predicted Range Error 31 

3.3.1 Lens- Aberration Error 31 

3.3.2 Laser-Line Localization Error 32 

3.3.3 Quantization Error 32 

3.3.4 Total Predicted Range Error 33 

3.4 The SPOTSCAN 2D Optical-Ranging System 36 

Chapter 4 CONTROLLED TESTING 38 

4. 1 Test Setup 38 



4 



4.2 Data 39 

4.2.1 Data Acquisition 39 

4.2.2 Raw Video Imagery 40 

4.2.3 Processed Profiles 41 

4.3 Range-Error Determination 43 

4.3.1 Tank and Target Model 43 

4.3.2 Range-Error Computation 46 

4.4 Empirical Results 47 

4.5 Comparison of Empirical and Analytical Error 49 

Chapters PRACTICAL APPLICATION 51 

5.1 Deep-Sea Modifications 51 

5.2 The SPOTSCAN 2D System at Sea 52 

5.3 High-Resolution Seafloor Surveys 56 

5.4 High-Spatial-Frequency Seafloor-Roughness Measurements 58 

5.5 Power Spectral Density from Laser Profiles 60 

5.5.1 Profile Selection and Resampling 60 

5.5.2 Power Spectral Density 63 

Chapter 6 CONCLUSIONS 67 

6.1 The Practicality of Underwater Optical Ranging 67 

6.2 Recommendations and Improvements 68 



5 



List of Figures 



Figure 2. 1 Spectral attenuation of optical and acoustical radiation 15 

Figure 2.2 LIDAR ranging system block diagram 20 

Figure 2.3 Beam-modulated ranging system block diagram 21 

Figure 3.1 Laser-camera coordinate systems 27 

Figure 3.2 Ray trace from image plane to object 28 

Figure 3.3 Simplified camera model 29 

Figure 3.4 Object localization within the laser plane 31 

Figure 3.5 Pixel projection on the laser plane 33 

Figure 3.6 Predicted range error for SPOTSCAN 2D 35 

Figure 3.7 Range error for varying baseline 35 

Figure 3.8 SPOTSCAN 2D block diagram 36 

Figure 3.9 SPOTSCAN 2D subsea components 36 

Figure 4.1 Video signal for data set 1 40 

Figure 4.2 Video signal for data set 2 40 

Figure 4.3 Video signal for data set 3 40 

Figure 4.4 Sample profile for data set 1 41 

Figure 4. 5 Sample profile for data set 2 41 

Figure 4.6 Sample profile for data set 3 42 

Figure 4.7 Sample profile for data set 4 42 

Figure4.8 Sample profile for data set 5 42 

Figure 4.9 Dataset 1 model 45 

Figure 4. 10 Data set 2 model 45 

Figure 4. 1 1 Data set 3 model 45 

Figure4.12 Data set 4 model 45 

Figure 4. 13 Data set 5 model 46 

Figure 4. 14 Observed range error 47 

Figure 4. 15 Empirical and analytical results 49 



6 



i 



3 



Figure 5.1 Full-ocean-depth (6000-m) subsea unit 52 

Figure 5.2 Remotely operated vehicle - Jason 53 

Figure 5.3 Down-looking configuration 54 

Figure 5.4 Detail of down-looking configuration 54 

Figure 5.5 Forward-looking configuration 55 

Figure 5.6 Detail of forward-looking configuration 55 

Figure 5.7 Typical bottom profile obtained during Crest '91 56 

Figure 5.8 Typical forward profile obtained during Crest '91 57 

Figure 5.9 Power-law relationship of the seafloor 59 

Figure 5. 10 Resampled bottom profile 61 

Figure 5. 11 Resampled forward profile 62 

Figure 5. 12 Resampled close-range forward profile 62 

Figure 5. 13 Power spectrum of bottom profiles 63 

Figure 5. 14 Power spectrum of forward profiles 64 

Figure 5. 15 Composite power spectrum of laser profiles 65 

Figure 5.16 Power spectrum of test tank data 66 



7 



List of Tables 



Table 4.1 Data set average ranges 39 

Table 4.2 Model parameters 44 



8 



>i5M(Tna Jiidl 



4 

'(KUMtq bboM 




T h 5M«T 



Nomenclature 



a . . 
p .. 

р. ^ 

Y •• 
Y./2 
4> .. 

K2 
A(|) . 

X . 

K • 

0 .. 
^0,1,2 

b .. 

с, •• 

c . . 

D .. 

— ♦ 

d .. 

/... 

/c •• 
— * 

g •• 
/ ... 

lo 

/x. • 

• 

• 



camera angle 
incident ray angle 
incident angle for pixel edge 
refracted angle 
refracted angle for pixel edge 
ray angle with laser plane 
laser phase measurements 
refracted ray variation 
wavelength 

modulated carrier wavelength 

fraction of modulated carrier 
wavelength 

direction angle from x axis 
quadratic coefficients 
baseline distance 
velocity of sound 
attenuation coefficient 
measured distance 
refracted-ray direction vector 
image distances 
range error 
frequency 
focal length 

gradient of image intensity 

intensity 

intensity at r = 0 

second derivative of image 
intensity in the x direction 

second derivative of image 
intensity in the y direction 

second derivative of image 
intensity in the x direction and y 
direction 



9 



i 



AAA 

ij, k unit vectors 

n wave cycles 

— * 

N laser-plane normal vector 

r distance travelled 

r object position vector 

^ max maximum range of object 

Vo baseline vector 

Ar pixel-pixel range variation 

R points in laser plane 

s direction of second directional 

derivative 

A/ measured time 

/ scaling parameter 

t. intersection parameter 

V propagation speed of laser pulse 

w pixel width 

x,y,z global axes 

X , V . z camera axes 

* ✓ c * c 



10 







f 




Chapter 1 

INTRODUCTION 

1.1. Background 



Remote sensing of the underwater environment takes on many forms and has many 
applications. Typical ocean surveys can include measurements of varied parameters from 
physical properties of the seawater itself to inferences about the biologies present. A 
fundamental measurement of ocean surveying, which in itself has many forms, is distance. 
Underwater ranging has typically been performed acoustically and, for most cases, this is the 
preferred method. However, as higher resolutions are desired, alternative optical methods 
provide advantages which favor this option. 

The varied disciplines studying the ocean today place a high demand on the engineer 
to develop and produce reliable and effective techniques for measuring their particular 
parameters. The acoustician who develops ranging instrumentation requires detailed 
information about material roughness to determine acoustic-backscatter properties. From the 
geologist who asks for an ability to measure the seafloor at scales from kilometers to meters 
and smaller to the archaeologist who wants detailed information on submerged artifacts, 
accurate and dependable ranging measurements, covering a wide spectrum of resolutions, are 
in high demand. To provide for one end of these requirements, optical-ranging methods 
capable of delivering high resolutions in the millimeter range have been developed. Although 
several of these methods have been proposed and implemented, few are available on a 
wide-commercial scale, and thus, fewer still have been analyzed and studied for feasibility in 
scientific applications. To help fulfill the requirement of a very-high-resolution underwater 
range-measurement technique this thesis offers a detailed analysis of a commercially available 
optical-ranging method. 
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1.2. Objectives 

The aim of this thesis is to determine if a commercially available very-high-resolution 
ranging system can be used for precise scientific range measurements underwater. One such 
system, the SPOTSCAN 2D from Seatex A/S of Trondheim Norway, was available for testing 
and analysis. The system employs a structured-lighting technique capable of millimeter 
resolution at very close range (< 2 m). A detailed description is presented in Chapter 3. 

The overall thesis objectives can be broken down into distinct tasks as follows; 

♦ Determine range-measurement performance of the system. 

♦ Test the system in a controlled environment and empirically determine performance. 

♦ Employ the system in an at-sea scientific application and evaluate its usefulness. 

The broad goal is to fully understand system performance and functionality so the 
system can be used to its full capabilities. In addition, scientific conclusions drawn from 
measurements of the environment must take into account careful consideration of the 
instrumentation used. With this in mind, this thesis analyzes a particular instrument and 
reports on its performance and capabilities. The system is studied in both a controlled-testing 
environment and in an at-sea application. Alternative systems capable of similar performance 
are briefly presented for comparison and to widen the scope of selection. It is hoped that the 
work performed here can assist others in choosing a system for high-resolution measurements 
in a deep-sea environment. 

1.3. Overview 

In the following chapter a brief overview is given of available underwater 
high-resolution ranging methods. A comparison is made of acoustical versus optical methods 
for very-high-resolution ranging and conclusions drawn about the advantages of optical 
systems. The issues associated with underwater optics and photogrammetry are discussed, 
and possible solutions are presented for the problems encountered. Available underwater 
optical-ranging techniques are then reviewed with the advantages and disadvantages of each 
method described. 
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Chapter 3 presents the details of structured-lighting techniques using a laser-light plane 
and single-camera system. The basic geometry is discussed and a simple model of the system 
is developed. A general approach is taken to develop equations for determining object range 
using photogrammetric techniques. These equations are then used to predict range error 
based on quantization levels in the digital-camera system and errors in locating the laser-light 
plane. The model is then applied to the SPOTSCAN 2D laser system and results are 
presented. Engineering and functional details of this specific laser system are also presented. 

In Chapter 4 controlled testing of the laser system is presented with the observed 
range-error performance. The test setup and conditions are described including detail of the 
targets used. A review of the data gathered is presented and then the range-error 
determination method is discussed. Examples of the test models are shown. The empirical 
results are then presented along with the previously determined analytical range error. 

Chapter 5 includes the at-sea performance of a modified SPOTSCAN 2D. The system 
was employed at depths in excess of 2200 m during Crest '91, a research cruise conducted 
near the Juan de Fuca Ridge in the Northeastern Pacific Ocean. The required system 
modifications for deep-sea capability are discussed along with the configurations used during 
these seafloor surveys. A brief discussion of a seafloor-roughness stochastic model is 
presented and the approximate power-law relationship of the seafloor power spectral density 
function is demonstrated using several types of data obtained during Crest '91. The 
technicalities and problems with using the laser system for these types of measurements are 
discussed and a workable solution is presented. The seafloor power spectral density function 
for very-high-spatial frequencies is computed from the laser profiles. Conclusions about 
system performance and practicality of at-sea use are made in Chapter 6. 
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Chapter 2 

HIGH-RESOLUTION UNDERWATER RANGING 



High-resolution remote-range measurements of the underwater environment have 
typically been made with high-frequency sonar. This yields resolutions in the centimeter 
range, but further increases require impractical frequencies. To attain these higher 
resolutions, optical techniques provide a viable alternative. In this chapter the major issues 
associated with optical techniques for underwater measurements are presented along with 
details of various optical-ranging methods in use today. 

2.1. High-Resolution Sonar 

Range measurements using acoustic techniques are most commonly performed by 
time-of-flight measurements. Attainable resolutions depend on the wavelength and width of 
the insonifying pulse [1]. At higher resolutions, shorter pulses and correspondingly shorter 
wavelengths are required. Frequency /is directly determined by the speed of sound and the 
wavelength X from 

/=X- (2.1) 

Therefore, shorter wavelengths require higher frequencies. However, as frequency is 
increased attenuation also increases monotonically [2]. Consequently, higher resolutions have 
higher attenuation and a corresponding limit on attainable range. In comparison, optical 
attenuation dictates a narrow transmission window around wavelengths of 500 nm (blue-green 
part of the spectrum). Figure 2. 1 shows the relationship of attenuation and wavelength for 
both optical and acoustic radiation [3, 4, 5, 6], Both source and target radiation are 
exponentially attenuated. A characteristic parameter is the beam-attenuation coefficient, c 
(1/m), where the beam intensity, /, is described by the Lambert-Beer law, 

I = Ioe~^^ ( 2 . 2 ) 
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Beam Attenuation, c (1/m) 



where r is the distance traveled, and is the intensity at r = 0. 




Figure 2.1: Spectral attenuation of optical and acoustical radiation [6] 
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2.2. Underwater Optical Ranging 

There are two basic methods for obtaining range information with light: time-of-flight 
and triangulation. Triangulation methods are possible using standard imaging techniques 
(stereoscopy) and do not necessarily require the use of lasers, however, the matching process 
required can be difficult [7]. Stereoscopic systems determine range measurements indirectly 
through the use of displaced dual-images using exact position information of either a 
single-camera or a dual-camera system. The object must be located in each image then ray 
traces are calculated using photogrammetric techniques. The range is determined by 
triangulation of the ray traces. As previously stated, these methods in themselves are 
complicated and require extensive processing techniques to solve the correspondence problem 
of locating the same object in two separate images. The matching process can be performed 
manually but this presents obvious disadvantages. In addition, the method does not provide 
direct range measurement. 

This thesis concentrates on single-image ranging techniques, which require precise 
lighting conditions to determine range information. The extremely accurate directional 
capabilities and distinct wavelengths of lasers make them ideal light sources for triangulation 
methods in underwater applications. Of the optical ranging methods available, this technique 
has currently proved to be the most viable for underwater applications [5]. 

Time-of-flight and phase-comparitor systems have been established as highly effective 
techniques in atmospheric conditions. Time-of-flight systems use a pulsed-laser and a 
time-elapsed device to measure the distance a laser-light pulse travels, then infer range from 
the measured time. Phase-comparitor systems use an amplitude-modulated laser beam and 
measure the difference between received and transmitted phases to determine the range. 

These systems are presented here for comparison but, in general, they have shortcomings 
when applied to the underwater environment. 

2.2.1. Underwater Optics 

Electromagnetic radiation has long been an effective tool for sensing techniques and in 
the transfer of information. However, for the most part these uses have been developed for 
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in-air applications, since high attenuation of electromagnetic radiation in water has deterred its 
development as a tool for this environment. Only in the past decade or two have attempts 
been made to utilize this source for underwater applications. Communication techniques 
have begun to show some promise [8] and, more recently, remote-ranging methods have 
demonstrated commercial success [9]. Underwater-imaging systems employing scanning 
lasers for illumination have demonstrated dramatic results in increasing visible ranges 
[10, 1 1,12] and, although not direct-range-measurement systems, the images produced can be 
used through photogrammetric (stereoscopic) techniques to provide useful distance 
information. 

Optical sensing in an underwater environment involves some of the same principles as 
acoustic sensing. A target is illuminated by a radiative source and the backscattered energy is 
detected and processed to determine the parameter of interest. Attenuation due to absorbtion 
and scattering [3] of the radiated energy as it travels through the water greatly affects the 
transmission range both to the target and back to the receiver. In addition, the dependence of 
refraction on wavelength causes dispersion, which produces an effect similar to chromatic 
aberration of lenses and thereby reduces resolution [13]. This problem can be overcome 
through the use of a single wavelength of coherent light, making laser applications attractive. 

Scattering by suspended material in the water increases attenuation and, in the case of 
imaging systems, a loss of resolution and contrast [14]. Asa rule, in ocean waters away from 
coastal regions particle concentrations decrease with increasing depth and for deep-water 
applications (>300 m) their effect is minimal [3]. However, remote surveying of the seafloor, 
particularly with optical methods, requires low altitudes that can lead to disturbances of the 
sediment and a correspondingly significant scattering problem. Methods exist for enhancing 
poor quality images resulting from these effects [15] but, in general, they are best avoided 
because of difficult implementation and interpretation of results. 
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2.2.2. Underwater Photograinmetiy 

As defined by the American Society of Photogrammetry [16]: 

Phologramnictry is the art, science, and technology of obtaining reliable 
information about physical objects and the environment through processes 
of recording, measuring, and interpreting photographic images and 
patterns of electromagnetic radiant energy and other phenomena. 

In this sense, underwater photogrammetry is the application of these methods to the situation 
where radiative source, receiver, and target are present in the underwater environment. 
Photogrammetric methods for obtaining range measurements involve a wide spectrum of 
mathematical principles and methods [17]. A detailed presentation of these principles is left to 
the references and instead only the notable anomalies encountered in the underwater 
environment are discussed. 

The principal difference in using a camera-lens system in the underwater environment 
is the presence of media with different refractive indices on either side of the lens. The 
principal and nodal points no longer coincide when the object space has a different refractive 
index than the image space [14]. This situation produces severe geometric distortions that can 
be overcome through the use of a special in-water lens or a front-port system between the 
water and in-air lens. The former presents further difficulties if the system must be used in 
varying underwater conditions since the refractive index for water can vary significantly with 
salinity, pressure, and temperature [4,14]. Front-port systems form a virtual image that 
behaves as the object for the camera. Rays from the true object are refracted at both the 
water-port interface and again at the port-air interface. The effect is a significant reduction in 
the field of view, however, the advantages and simplicity of the design make it a likely choice. 
Domed ports and fully corrective ports can provide distinct advantages over a simple planar 
port but their complexity and cost can be prohibitive. 

2.2.3. Laser-Ranging Systems 

The use of lasers in optical-ranging systems makes time-of-flight optical methods 
workable and can greatly simplify the design and implementation of triangulation systems. In 
the underwater environment the use of a single wavelength of coherent light avoids dispersion 
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problems encountered from the dependency of refraction on frequency. Advances in 
solid-state-laser design have made the use of these systems possible in underwater applications 
[18], Due to the high absorption by ocean water of electromagnetic radiation in all but the 
blue-green part of the visible spectrum, it is desirable to use wavelengths around 500 nm. In 
addition, for underwater applications concerns about size, power requirements, 
data-transmission limitations, and reliability place demands on lasers systems that have only 
recently been met [5]. Neodymium:Yttrium-Aluminum-Garnet (Nd;YAG) diode-pumped 
lasers using frequency doubling [19] have been invented and meet the requirements for an 
underwater laser-ranging system. The commercial system studied in this thesis uses such a 
laser operating in a continuous mode. 

2 . 2 . 3 . 1 . Laser-Radar Ranging Systems (LID AR) 

Laser radar or lidar systems typically employ a pulsed-laser transmitter and 
photodetector receiver [19,20,21]. Figure 2.2 [20] shows the basic components in a typical 
laser timed-pulse distance-measurement system. The transmitted pulse is detected and opens 
an electronic gate that connects an oscillator to a high-speed counter. The gate is 
subsequently closed when the return signal is detected by the receiving optics. The range is 
obtained by measuring the time required for the light to travel from the transmitter to the 
target and back. The distance is given by 

D = ^ (2.3) 

where D is the distance measurement, t is the measured time, and v the speed of propagation 
of the laser pulse, corrected for ambient conditions. Available underwater technology limits 
pulsed-laser ranges to approximately 100 m due to attenuation [10]. At these ranges the 
transit time is extremely small. Errors in this method are mainly related to accurate 
measurement of this short transit time. In addition, difficulties presented by the underwater 
environment from refraction and scattering make this method hard to implement for 
high-resolution underwater ranging. 



19 



Manual 

Trigger 


■ ■ 


Pulser 








> 


f 




Laser 

Diode 



Laser Transmission 



0 - 




Oscillator 



ik- 

-> Gate 



Photo- 

detector 



Photo- 

detector 






Range 

Counter 



Receiving Optics 



> Display 



Figure 2.2; LIDAR ranging system block diagram [20] 



2. 2. 3.2. Aniplitude-Modulated Ranging Systems 

In this method the beam amplitude is modulated and the phase shift of the reflected 
light is measured. The device transmits a laser beam modulated with a sinusoidal wave form. 
When the beam strikes an object, a portion of the light is reflected back to the receiver. The 
phase of the returned signal is measured and compared with the reference phase. The relative 
difference is proportional to the distance traveled and can be expressed in terms of the 
modulation wavelength as 

2D = vX„+^X„, (2.4) 



where D is the distance traveled, n is the integer number of completed cycles, and is the 
fraction of a wavelength left over. By measuring the phase of the transmitted wave, (]),, and 
that of the returned signal, <j) 2 , AA.„ can be determined from 

(2.5) 






360" 



The distance D is made up of two components and in a phase-comparitor system only AX„ can 
be determined. To find the total distance the nX„ term must be resolved. This is referred to as 
resolving the ambiguity of the phase comparison and is commonly performed by increasing the 
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wavelength in multiples of 10 so a coarse measurement of the distance can be made and 
subsequently converged to the required resolution. 

Figure 2.3 [20] shows the essential components for a phase-comparison 
beam-modulated ranging system. The laser beam and carrier signal are mixed together in a 
modulator and the resultant beam is transmitted. The reflected beam re-enters the instrument 
and demodulation takes place. Comparison of the reference and transmitted signals produces 
the required phase difference, which is used along with the resolved ambiguity to determine 
the range. 




Figure 2.3: Beam-modulated ranging system block diagram [20] 
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2. 2. 3.3. Structured-Ligliting Teclmiques 

Stmctured-lighting techniques offer an attractive alternative to time-of-flight methods 
because there is a relatively simple implementation that allows processing of a line instead of a 
single point. This approach is based on the light-strip sensing technique [22,23,24] and 
incorporates photogrammetric algorithms [25]. The process projects a plane of light onto an 
object and acquires the resultant line's image. The position and geometry of the light source 
are known and, through ray tracing, points on the line are determined by intersection with the 
light plane. Since the light plane has finite thickness the assumption of a plane can pose 
difficulties. However, by employing line-finding algorithms [7] a thin line corresponding to 
the plane can be determined. Beginning with a thin plane improves system performance, 
suggesting the use of a laser. Another source of error is generated by quantization of the 
line's image, posing a limitation on the resolving capability of the system. A detailed 
discussion and analysis is presented in the following chapter. 
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Chapter 3 

LASER-PLANE STRUCTURED LIGHTING 



In this chapter the details of laser-plane structured lighting are presented. The 
image-processing techniques for laser-line determination are discussed, and a 
second-directional-derivative line-finding routine is derived. The basic geometric principles 
for determining range with structured lighting are presented, and a simple model of a 
structured-lighting system employing a laser-light plane is developed. System range error is 
analytically predicted using the model. A fully functional laser-plane structured-lighting 
ranging system, the SPOTSCAN 2D from Seatex A/S, is then described. 

3.1. Laser-Line Detennination 

In a laser-plane structured-lighting system the intersection of the laser plane and an 
object in its path produces a line in the camera image. By determining the exact position of a 
line in the image, the corresponding points in the laser plane can be determined through 
photogrammetric techniques. The laser-line image will typically contain noise generated by 
ambient illumination. A line-finding routine should reject those pixels corresponding to noise 
and retain the pixels illuminated by the laser light. This suggest thresholding techniques since 
the laser light amplitude is expected to be significantly greater than other sources. However, 
since the laser-line image is typically wider than a single pixel, thresholding in itself will not 
yield the desired results because it produces a line wider than a single pixel and voids the 
thin-plane assumption required by the geometry for object localization. 

The light-stripe method [22] thresholds the pixel intensities then uses their center of 
mass as the line determination. This method is viable and will produce correct results, 
however it only considers intensity values in a one-dimensional sense. The image is broken 
into discrete horizontal or vertical lines and thresholding is applied to the pixels within this 
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line. The resultant pixels are then used in the center of mass determination to locate the laser 
line. Another method that uses a two-dimensional search for the line will tend to produce 
better results since it considers more of the surrounding pixels in line determination than the 
light-stripe method. 

A method that uses two-dimensional information of the image for line localization is 
the second-directional-derivative line-finding routine [7], A bright line can be thought of as a 
crest in the intensity values of an image. The second directional derivative is most negative 
along the direction orthogonal to the crest. In this direction the first derivative of intensity 
values changes sign and the second derivative is less than zero. The first directional derivative 
is zero at the top of the crest, however, it is unlikely to locate this exact point. 

It is more feasible instead to search for zero-crossings (where the sign changes from 
positive to negative or vice versa). The directional derivative ^ in the direction specified by 

the angle 0 with the x axis is given by [26] 

|- = cos0^ + sine^ (3.1) 

os ox dy 

Applying this twice to the intensity / gives the second directional derivative 

0 = +/J + ^(/«-/».) COS20 + 1 :^ sin20 (3.2) 

The direction in which this is maximized or minimized is found by differentiating with respect 
to 0 and setting to zero 

1 ( 0 ) =» 

or 

-^/xr - sin 20 + 21 xy COS 20 = 0 (3.4) 



resulting in 



or 

2 /„, 

tan 20 = _ 

^xx “ ^yy 



sin 20 = 




(3.5) 



(3.6) 



24 



and 



cos 20 = 




Substituting into (3.2) gives 



d^I 



ds^ 



max,min 




(3.7) 



(3.8) 



or 



ds^ 



niax,niin 



± j(/^ A?") 



+ 4/^ 



(3.9) 



Since the radical term is positive, the direction of the most negative second directional 
derivative is given by the negative root in (3.9) or 

COS 20 = - ..v.zj.ijz--..- - (3.10) 



So 



where 



|cos0| = 



S+ 



(/„.-/„) 



J2S 



and 






I sin 0 1 = 






J2S 



(3.11) 



(3.12) 




(3.13) 
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Since traversing the line orthogonally, regardless of direction (0 or 0 + k), yields the most 
negative second directional derivative, 0 is defined so that cos 0 >0. Therefore, the sign of 
sin 0 is given by -sign(I^) since S is positive and 



sin 20 = 2sin0cos0 = 



- 2 /;^ 

S 



(3.14) 



The direction is then given by the unit vector s where 



■= -^1 js+(l„-lj) /-signa..,) ^5+ (/„-/„) j| (3.15) 



The first directional derivative of the intensity can be considered as the dot product of the 
intensity gradient g and the direction vector s, since 



and 



So for 



s = cos 0/ + sin 0/ 


(3.16) 


dl ndl ^ . ndl 

-5- = COS0-5-+ Sln0■5- 
O5 ox dy 


(3.17) 


A A 

g = I^i + Iyj 


(3.18) 


SI t. 


(3.19) 



A search for the zero-crossings of the dot product of the intensity gradient and the direction 
of the most negative second directional derivative locates lines within the image [7], 



Filtering of the image in either of the cases presented can reduce noise prior to line 
detection yielding better results. Filtering blurs the line, however, the methods presented can 
counter this effect, since they are adapted to determine thin lines from thicker smeared or 
blurred lines. If ambient levels produce noise above or near the amplitude of laser illumination 
then a two-dimensional routine such as the one presented here should be employed to reduce 
false localization of points not associated with the laser line. 

A significant drawback of the two-dimensional line-finding routine or prior filtering of 
the image is the increased computational resources required. The center-of-mass thresholding 
technique is generally much faster and produces satisfactory results for most applications. 
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3.2. Laser-Camera Geometry 

Once the laser-line position has been determined within the image, basic geometric 
principles can be used to determine its location within the laser plane. Since the line 
represents the intersection of the laser plane and the object to be ranged, its location 
corresponds to object range. To determine range using laser-plane structured lighting, the 
coordinate system shown in Figure 3.1 is established. The global coordinate axes are placed 
such that the laser plane lies in the x-z plane as shown. The camera coordinate axes are 
aligned with the origin at the cameras center of projection, axis along the optical axis, and 
the 2 ^ axis parallel to the laser's (global) z axis. The camera is rotated about its z^ axis through 
an angle, a, so the field of view is optimal for the range-finding system. 




Figure 3.1; Laser-camera coordinate systems 
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Air/Image Space 



lens 



Water/Object Space 




Figure 3.2: Ray trace from image plane to object 



An object lying in the laser plane reflects its light and the corresponding image can be 
used to determine the object's location within the laser plane. This is accomplished by tracing 
the ray of light from its point of illumination in the image plane through the camera/air space, 
the camera lenses, and the water medium to the intersection with the laser plane [4] (see 
Figure 3.2). Each point in the image plane defines a ray through the camera-lens focal point. 
After accounting for refraction at the various interfaces, this ray defines a line in the global 
space of Figure 3.1. The determination of this ray's position in the global coordinate system is 
crucial in locating the corresponding object in the laser plane. Errors in the ray position are 
caused by inaccuracy in estimating the various interactions of its path. 

The image of an object point produced by a lens system will not be a distinct point but 
a blur, even in the plane of best focus [27]. These image imperfections are called aberrations 
and are measured quantitatively by the size of the blur. In the inverse problem considered for 
structured-lighting techniques, due to lens aberrations, the image point must be considered a 
small disc when projected on the laser plane. To simplify the photogrammetry involved a 
pinhole-camera model is used with a single air-water interface (i.e., lens thickness is 
negligible), and the lens aberrations are considered as errors in determining the ray's position 
within the global coordinate-system. The lens-aberration effects are further discussed in the 
following section on error analysis . Figure 3.3 demonstrates the model. 
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Figure 3.3; Simplified camera model 



A point in the image plane is defined by the location {d^, d^. The angle P is the 
incident angle on the interface and is given by 

Jdj-¥dl 



P = arctan 



V 



fc 



(3.20) 



/ 



where is the focal length of the camera lens. The refracted angle, y, is given by Snell's Law 
as 



. f sinp^ 
y = arcsin 



(3.21) 



where n is the relative index of refraction. From y the refracted ray now defines a line d in the 
camera coordinate-system where 

A A A 

(3.22) 



d = dxi + dyj+dzk 



dx^ 



tan 



W 



(3.23) 
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To determine the range specified by a point in the image plane, the intersection of the 
line with the laser plane must be determined. Transforming to the global coordinate axes 
using the transformation equations 

x = XcCosa+jcsina (3-24) 

j=>'cCosa-Xcsina + 6 (3.25) 

the line is now given in the laser frame of reference by the position vector r{t) where 

r{t) = ro + td (3.26) 

ro=bj (3.27) 

b is the baseline distance from the camera to the laser and / is a scaling parameter. 

— » 

The laser plane is defined by the vector R where 

N-R = 0 (3.28) 

N=bj. (3.29) 

N is the laser-plane normal vector. The intersection of the ray trace and the laser plane 
occurs at ?(6), as shown in Figure 3.4, where 



-N-T-o 

N-d 



or substituting (3.22), (3.27), and (3.29) into (3.30) 




(3.30) 



(3.31) 



and (3.22), (3.27), and (3.31) into (3.26) 

Ktd^i^idxi + djc). 



(3.32) 
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Figure 3.4: Object localization within the laser plane 



3.3. Predicted Range Error 

Range errors incurred by a laser-plane structured-lighting technique include those 
caused by lens aberrations, image quantization, laser-line localization, and calibration errors in 
determining camera and laser relative positions. Calibration errors are affected by the method 
of calibration employed and are difficult to quantify. For this study it is assumed that 
calibration errors are negligible when compared with other sources. 

3.3.1. Lens- Aberration Error 

In a laser-plane structured-lighting ranging system the image point determines a ray 
path used to find an object's location within the laser plane. However, in a real camera-lens 
system the image point corresponds to several possible ray paths due to lens aberrations [27]. 
The overall effect is that a point on the image plane corresponds to a small disc on the 
laser-light plane. The effect on range-measurement performance of the system is that an 
object anywhere within this disc is considered as being at the disc's center. A camera-lens 
system typically measures the lateral lens aberration (perpendicular to the optical axis) in the 
image plane of best focus [27]. Results are reported as radial distortion and are a function of 
the height of ray incidence along the lens. These results are nonlinear and difficult to model. 
For the purpose of this error analysis the worst-case distortion is assumed for all image 
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locations and determined by projecting the distortion onto the laser plane. This is combined in 
a later section with the other error sources to determine total system range error. 



3.3.2. Laser-Line Localization Error 

As discussed in Section 3.1 the laser light usually illuminates more than a single pixel. 
Methods to determine which pixel corresponds to the laser-plane center should be 
implemented to minimize errors from this source. The geometry of a structured-lighting 
system can determine the number of pixels illuminated by a thin laser beam at varying ranges; 
divergence will cause its thickness to increase with range and must also be taken into account. 
A typical Nd:YAG laser beam (as used in the system tested) with a full-angle divergence of 
2.2 mrad and a beam width of 1 mm at 1-m range will have a thickness of 8 mm at a 4-m 
range. Because of the small angle this increase can be assumed linear. The beam spreading 
will causes more pixels to be illuminated at higher ranges, increasing the difficulty in correctly 
locating the laser line. 



3.3.3. Quantization Error 

To determine ranges, the camera image must be quantized into individual pixels. Each 
pixel transforms into an area patch on the laser plane as shown in Figure 3.5. The area patch 
is determined by defining each pixel as a small square on the image plane and transforming its 
four points as in the previous section. An object that lies within this area patch illuminates the 
corresponding pixel and the range is determined as that which corresponds to the pixel's 
center. 
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Figure 3.5: Pixel projection on the laser plane 
3.3.4. Total Predicted Range Error 

A laser-plane structured-lighting system, as described in this study, can only determine 
range to the resolution of the projected pixels. The approach assumes that an object in the 
laser plane corresponds to a single pixel and reports the center of that pixel as the object's 
range. An error in the laser-line localization causes a corresponding error in range. These 
effects are often caused by ambient-lighting noise sources and are difficult to quantify. The 
range error is predicated by determining all possible ranges that could illuminate a particular 
pixel. The lens-aberration distortion is included in this range-error determination by adding 
the maximum distortion size to the pixel boundary then projecting the resultant area to the 
laser plane. Although the range error occurs in both the x and z directions, the total range 
error from the laser origin is considered for performance analysis. 

The maximum range of an object determined to be at r(/,) corresponds to the distant 
corner of the area patch shown in Figure 3.5 and the minimum to the near corner. The range 

error for a particular pixel is defined as the difference between the maximum possible range of 
an object and the determined range (since the difference between the minimum possible range 
and the determined range is less because of the geometry). 
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Defining the pixel width, including the lens-aberration distortion, as w, the maximum 
range is given by 

^(d, + Ad^yi + (d,-w/2)k 



^ max — 



dy - wH 



(3.33) 



where At/^is determined as in Section 3.2 by first computing the new incident angle which 
accounts for the pixel-width changes in d^ and d^ and the new refracted angle 

J(dy -w/2^ +(dz -w/2^ 



Ph ’/2 = arctan 



/c 



dr + Adr = 



. ( sinpH-/2'^ 

Ym-/ 2 = arcsin — - — j 

Ji^y -w/2^ + (dz - w/2^ 



tan 



(t»^) 



(3.34) 



(3.35) 



(3.36) 



This method does not consider possible angular errors at each pixel, however, these 
are negligible compared to range errors, which are of more concern in determining system 
performance. An algorithm was developed to determine error at each determined range using 
this method. The results for a fully functional commercially available system, the 
SPOTSCAN 2D, are shown in Figure 3.6. The baseline distance is 150 mm and the camera 
angle a is 10". 

From the geometry presented it can be seen that decreases in range error are made 
possible by increasing the baseline distance b. However, as the baseline is increased the 
transmission path of the light ray is also increased and attenuation loses are correspondingly 
greater. To demonstrate the sole effect of increasing baseline. Figure 3.7 shows the results for 
baselines from 100 mm to 250 mm with a camera angle of 10". It should be noted that 
changing the camera angle has no effect on the range-error performance and only affects the 
field of view and usable range of the system. 
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Figure 3.6: Predicted range error for SPOTSCAN 2D 




Figure 3.7; Range error for varying baseline 
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3.4. The SPOTSCAN 2D Optical-Ranging System 



The SPOTSCAN 2D system is a fully functional underwater-optical range-finding 
system employing the laser-camera structured-lighting method, designed and marketed for 
subsea-pipeline inspection. The system comprises a subsea unit, a scan-processor unit, and a 
high-resolution-graphics display (Figure 3.8). 




Figure 3.8: SPOTSCAN 2D block diagram 




Figure 3.9; SPOTSCAN 2D subsea components 
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The subsea unit (Figure 3.9) consists of a camera-laser unit and a laser power-supply 
unit. The camera-laser unit houses the CCD camera, the laser, and a microprocessor. The 
camera is designed to detect low light levels and uses automatic gain and iris controls to avoid 
blooming caused by overexposure [28]. The laser is a 5-mW frequency-doubled, 
diode-pumped Nd:YAG green laser (532 nm). A humidity sensor to detect leakage and 
inclinometers for pitch and roll measurements are also contained within the camera-laser 
assembly. The subsea microprocessor is used for camera control and communications with 
the surface processor. The laser power supply contains a regulation system to ensure a stable 
laser-light level. The standard housing is rated for a maximum depth of 1000 m [9], 

Images are digitized and processed by the scan-processor unit using transputer 
coprocessor technology to obtain real-time display of profile data. The digitized images have 
a frame resolution of 256 (H) x 192 (V) and the CCD dimensions are 14.8 mm x 1 1. 1 mm. 

The camera system uses a wide-angle lens with a focal length of 25 mm. The CCD 
system-control software runs on a 80286 AT personal computer at 16 MHz and is displayed 
on a separate monochrome monitor; profiles are displayed on the secondary high-resolution 
graphics monitor. Data can be stored on digital audio tape (DAT) secondary storage or 
directly to the processor unit's disk drive. A hardcopy unit is included to provide 
documentation of the video display [9] . 

The subsea unit is calibrated by the manufacturer using a high-precision 
three-dimensional range. Calibration parameters are stored and accessed by the processor unit 
for computing profile data. Pitch and roll measurements are used along with the video frame 
image to output profile points in a gravitational frame of reference. 

Previous testing of the SPOTSCAN 2D has been carried out to demonstrate its use as 
a pipeline inspection tool [9]. These tests have shown a typical accuracy of 5 mm at a range 
of 1 m and reported a quadratic variation of accuracy with range. Although, in Section 3.3.4 
it was shown that range accuracy is based on transcendental functions. 
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Chapter 4 

CONTROLLED TESTING 



In the last chapter, predicted range error of the SPOTSCAN 2D laser-ranging system 
was determined. To verify these expectations the system was tested in a controlled 
environment with known constraints. The results of those test are presented here with 
comparison to the analytically determined error. 

4.1. Test Setup 

The laser system was tested in a cylindrical tank of depth 3.3 m and diameter 4.4 m. 
The tank was filled with clear fresh water at approximately 25'’C. Figure 2. 1 shows that 
attenuation of the frequency-doubled Nd;YAG blue-green laser is minimal for these test 
conditions. The effects of water clarity, salinity, pressure, and temperature were not tested as 
part of this study. 

A 20-cm diameter pipe section was placed at the tank bottom and used as a primary 
target. The subsea unit was suspended and positioned at different ranges from approximately 
1.0 m to 3.3 m from the target's center. Positioning of the pipe at the bottom of the tank close 
to the tank wall also allowed the tank itself to be used as a target. The tank walls actually 
became crucial in determining system performance since their perpendicularity could be 
assumed, making system position determination easier. For the close-range test, at 
approximately 0.6 m from the bottom corner of the tank, an additional target was used. A 
cylindrical shape (a screwdriver handle) of approximate 25-mm diameter was found near the 
tank's corner. Two data sets were taken at this range; one with the pipe as the primary target 
and the other using the small cylinder. 
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4.2. Data 



4.2.1. Data Acquisition 

At each range, approximately 75 profiles were recorded on the DAT recorder at 
intervals of 1 s. Prior to profile recording the system position was allowed to stabilize so that 
movement of the camera-laser subsystem would be minimal during profile recording. The 
number of profiles and average ranges to the primary target center and tank's bottom corner 
are included in Table 4. 1 for each of the five data sets. 



Data Set 


Profiles 


Primary Target Range 


Tank Corner Range 






(m) 


(m) 


1 


79 


0.97 


1.02 


2 


73 


1.01 


1.27 


3 


75 


1.95 


2.42 


4 


73 


2.59 


3.25 


I ^ 


72 

I I 


3.27 

1 


4.05 

) 



Table 4.1; Data set average ranges 
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4.2.2. Raw Video Imagery 



The SPOTSCAN 2D system also includes hardware that allows hardcopy output of 
the raw video signal, however, several seconds are required for each copy and only a single 
copy was obtained for each data set. Examples of the raw image are shown in Figures 4. 1 
through 4.3. 





Figure 4.3; Video signal for data set 3 
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4.2.3. Processed Profiles 



The system output consists of up to 256 (x,z) locations within the laser-plane. The 
raw video images are processed in a manner similar to that described in Section 3.2. The 
image is digitized and divided into 256 horizontal lines. For each horizontal line the location 
of the laser return signal is determined from the center of mass of thresholded image intensity 
values. Using this location as the <J^ range of the image and the line number as the range, 
the distances in the laser-plane x and z directions are determined. If the intensity in a line is 
below a certain threshold, a corresponding point is not determined. Figures 4.4 through 4.8 
contain sample processed profiles for data sets 1 through 5 respectively. Individual data 
points are plotted as small circles for clarity and do not indicate an accuracy range. 




Figure 4.4; Sample profile for data set 1 Figure 4.5: Sample profile for data set 2 
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Figure 4.6; Sample profile for data set 3 



Figure 4.7: Sample profile for data set 4 




Figure 4.8; Sample profile for data set 5 
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4.3. Range-Error Detennination 

Range Error is computed by comparing the laser-system determined range with the 
actual range to the target. The underwater test made it difficult to measure the actual 
distances so an alternate method was developed. A model of the tank and primary target is 
developed for each of the data sets, and the range error between the output data and the 
model determined. Errors are accumulated for all ranges and the average error used to 
empirically determine the system's range-error performance 

4.3.1. Tank and Target Model 

The tank model assumes the walls to be exactly straight, horizontal, and vertical. A 
circular model is used for the primary targets with diameter of 20 cm for the pipe section and 
25 mm for the smaller cylinder. Varying parameters of the model include the precise wall 
locations and the primary target location with respect to the tank corner. The wall locations 
are determined for each individual profile since they can vary slightly due to any small motion 
of the subsea unit. On the other hand, target location is assumed fixed with respect to the 
tank's bottom corner throughout each data set since there is no relative motion between the 
target and tank. Target location with respect to the tank's bottom corner varies between data 
sets due to repositioning of the subsea unit longitudinally along the pipe. 

Horizontal wall location is determined from the average range of points falling within a 
band in the vicinity of the wall. The assumed error band is from the analytically determined 
error shown in Figure 3.6. In addition, all points within twice the error distance from the 
primary target or vertical wall are omitted from the group. Since this method requires 
knowledge of the vertical wall and primary target locations it must be accomplished iteratively 
and concurrently with the determination of other parameters. The vertical wall location is 
found in the same manner using horizontal displacements without regard to the primary target 
location, since in all cases the target is sufficiently far from the vertical wall. 

Target location is determined by first making a visual estimate then correcting each 
individual profile to minimize the range error of those points obviously on the target. The 
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target location used for each data set is then determined by taking the average of the relative 
distance between the target center and the vertical wall location for each profile. 

Table 4.2 contains the average values of the wall locations and the target locations for 
each data set. Figures 4.9 through 4.13 show sample models used in the range-error 
determination for each data set. 



Data 


Average Horizontal 


Average Vertical 


Primary Target 


Set 


Wall Location 


Wall Location 


Displacement from 




(m) 


(m) 


Vertical Wall (m) 


1 


0.55 


0.85 


0.09 


2 


0.91 


0.89 


0.41 


3 


1.63 


1.79 


0.83 


4 


2.26 


2.34 


1.11 


5 


2.77 


2.96 


1.35 



Table 4.2: Model parameters 
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Laser x-oxis Ronge (m) Loser x-oxis Range (m) 





Figure 4.9; Data set 1 model Figure 4.10; Data set 2 model 





Figure 4.11; Data set 3 model Figure 4. 12; Data set 4 model 
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Figure 4.13: Data set 5 model 



4.3.2. Range-Error Computation 

The range-error computation consists of comparing the laser system's determined 
range at each data point to the range of the model. For each data point a line is drawn from 
the laser origin through the data point. The range error is computed by determining the 
distance along this line from the data point to the model. This error is then accumulated in 
bins for each range using the range to the model as the true range. These accumulated errors 
are then averaged for each range bin to determine the total range error shown in Figure 4. 14. 
To ensure statistical significance only bins with 100 or more accumulated range-error values 
are included in the plot. 
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Figure 4. 14: Observed range error 



4.4. Empirical Results 

The shape of the data plotted in Figure 4. 14 suggest a quadratic curve fit [9], Using a 
least-squares method the following empirical relationship is derived for range error in terms 
of range r. 

er = ao+air + a2r^ (4.1) 

Another selection for an empirical relationship can be obtained by making 
second-order approximations to the method of Section 3.2. First, consider that the ray path 
to the laser plane makes an angle (j) with the>" axis of Figure 3.4. Then consider that the 
angular variation of the refracted ray (obtained by moving from pixel to pixel) can be 
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approximated by a constant A(j). The range r to the object in the laser plane is given in terms 
of the baseline b and the angle <]) by 

r = 6 tan (j) (4.2) 

and the change in range Ar from moving to the next pixel is given by 

A/' = Z>(tan((J) + A(j)) - tan (J)) (4.3) 



or 



Ar = 



b sin A(j) 

cos(j)Cos((j) + A<t)) 



(4.4) 



For ranges greater than 1 m with a baseline b oi 0. 15 m, the angle <|) is greater than 
81.5° and a small-angle approximation is feasible for the opposing angle 90° - Now writing 
Ar as 



Ar = 



b sin A(j) 

sin(| - (j)) sin(| - (]) - A(j)) 



(4.5) 



or with a small-angle approximation 



A/ = 



^>A(1) 



(f-d))(f-c|)-A<|)) 



(4.6) 



This can be written as 



ao +air + 02r'^ 



(4.7) 



since with the small-angle approximation ({> is linearly proportional to r and all other terms are 
constants. Using this approximation, a least-squares curve fit is non-linear and difficult to 
calculate. However, by taking the reciprocal of the above equation the problem is greatly 
simplified. The results from this fit and the previous direct quadratic fit are shown in Figure 
4. 15 along with the analytical results of Section 3.3. 
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Figure 4. 15: Empirical and analytical results 



4.5. Comparison of Empirical and Analytical Error 

Figure 4. 14 shows the range error determined by controlled testing of the SPOTSCAN 
2D laser-ranging system. These tests confirm previous reports of 5-mm accuracy at 1-m 
range [9]. Significant error begins to occur beyond 2.5 m. At approximately 3.5 m there is a 
distinct break in the trend of the error. The range-error values in this area are entirely from 
data set 5 and suggest an anomaly associated with these data alone, however, no plausible 
explanation has been found. 

Figure 4.15 demonstrates that the analytical error determined in Section 3.2 is very 
similar to the observed error for ranges less than 2.5 m. However, at the higher ranges the 
analytical error is less than the observed error by almost a factor of two. This is partly 
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attributed to spreading of the image at higher ranges and additional signal loss from 
attenuation. As the image intensity decreases with range, the auto-iris and auto-gain features 
attempt to maintain detection by increasing camera exposure. Overexposure produces 
blooming of the CCD [28], which causes the imaged laser-line to smear and blur. In addition, 
the error analysis does not consider other sources of error, such as those encountered during 
system calibration, or errors in the model determinations of Section 4.3.1. 
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Chapter 5 

PRACTICAL APPLICATIONS 



Although the SPOTSCAN 2D system has demonstrated commercial success as a tool 
for subsea pipe inspection an aim of this thesis is to evaluate its feasibility as an instrument for 
scientific applications. For this study, a high-resolution seafloor survey application was 
undertaken to investigate the power-law relationship of the seafloor in very high 
spatial-frequency regions (>10' cycles/m). 

5.1. Deep-Sea Modifications 

The SPOTSCAN 2D system as tested in Chapter 4 is rated for depths to 1000 m, 
which is adequate for the purpose of pipeline inspection. However, for this application 
full-ocean-depth (6000 m) capability was required. Figure 5. 1 shows the more capable 
configuration as designed and implemented by the Woods Hole Oceanographic Institution's 
Deep Submergence Lab and Seatex A/S. Most obvious is the dual-bottle configuration to 
house the camera and laser subsea unit. An added benefit of this approach is the larger 
baseline permitted by housing the camera and laser in separate containers. Although vehicle 
space considerations, system geometry, and laser attenuation prevented a dramatic change, the 
baseline was nevertheless increased from 150 mm to 400 mm. This should have improved 
system range-error performance as discussed in Section 3.2, however, there was no 
opportunity for controlled testing of this configuration as described in Chapter 4 for the 
single-bottle. Aside from the housing modifications all other aspects of the system are as 
described in Section 3.3 and as tested in Chapter 4. 
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Figure 5.1 : Full-ocean-depth (6000-m) subsea unit 



5.2. The SPOTSCAN 2D System at Sea 

The SPOTSCAN 2D system was employed as a high-resolution survey instrument on 
the remotely operated vehicle (ROV) Jason (Figure 5.2). The Jason ROV is a 
full-ocean-depth tethered vehicle capable of performing remote sensor surveys at close ranges 
with a suite of sonars, video imaging equipment, and electronic still cameras. The vehicle was 
employed extensively from the R/V Laney-Chouest during the Crest '91 cruise in the Northern 
Pacific. Project Crest, supported by the Office of Naval Research, included an effort to 
perform innovative high-resolution, high-precision mapping, and manipulation activities in a 
challenging ridge-crest environment (2200-m to 4800-m water depth). The primary area of 
operation was the Endeavour portion of the Northern Juan de Fuca Ridge in the Northeastern 
Pacific. 

A portion of the high-resolution surveys during Crest '91 was dedicated to obtaining 
detailed information about seafloor roughness in the region. The SPOTSCAN 2D 
laser-ranging system was suited to these high-resolution surveys but had never been deployed 
at such depths nor used for a scientific study of seafloor conditions. 
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Figure 5.2; Remotely operated vehicle - Jason 



The laser system was initially configured in a down-looking mode and mounted aft on 
the Jason ROV as shown in Figures 5.3 and 5.4. This allowed bottom surveys to be carried 
out but presented some difficulty due to the limited range of the laser system. Surveys had to 
be performed at typical altitudes above the seafloor of less than 3 m for reasonably good 
profiles (more than 100 data points) because attenuation at longer ranges was too high for a 
strong light-signal return. In addition, the aft piloting lights of the vehicle had to be secured 
for optimal laser detection. These affects combined to make piloting of the vehicle an extreme 
challenge during the high-resolution laser surveys. In order to perform surveys in an alternate 
configuration, the system was mounted on the forward end of the Jason ROV and in a 
forward-profiling configuration as shown in Figures 5.5 and 5.6. This mode, combined with 
the excellent maneuverability of the Jason ROV, allowed detailed surveys to be performed on 
ledges and escarpments. In this mode the vehicle's piloting lights also had to be secured for 
laser surveying. The laser system was incapable of functioning to any degree when Jason's 
forward high-intensity flood lamps were energized. 
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Figure 5.3; Down-looking configuration 




Figure 5.4; Detail of down-looking configuration 
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Figure 5.5: Forward-looking configuration 
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5.3. High-Resolution Seafloor Surveys 

Approximately 6600 laser profiles of the seafloor were obtained during the Crest '91 
cruise. These can be broken down into roughly 4100 bottom profiles and 2500 forward 
profiles. The profiles were obtained over two separate 2-day periods on the 4th and 5th, and 
the 15th and 16th of August 1991. Other operations prohibited continuous laser profiling 
during these periods. Even during the committed laser surveys the difficulties encountered 
with the ROV piloting lights caused profile recordings to be intermittent. The effect of 
energized lights corrupted several of the profiles and of the 6600 obtained approximately 50% 
have usable data. 




Figure 5.7: Typical bottom profile obtained during Crest '91 
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Figure 5.8; Typical forward profile obtained during Crest '91 

Figures 5.7 and 5.8 show two typical laser profiles in the down-looking and 
forward-looking configurations. Under optimal conditions, where all 256 horizontal lines of 
the image contain intensity values above threshold, the system produces 256 points per 
profile. Due to the rough and erratic nature of the seafloor this is rarely the case. The 
uncorrupted profiles had, on average, 200 points in the down-looking configuration and 155 
in the forward-looking configuration. The profile of Figure 5.7 contains 210 points and that 
in Figure 5.8 has 157. In most cases this is sufficient to obtain the necessary seafloor 
amplitude measurements. 
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5.4. High-Spatial-Frequency Seafloor-Rougluiess Measurements 

Seafloor-roughness determination has many practical and engineering applications 
particularly in the field of ocean acoustics [29]. Interactions of acoustic signals with the 
seafloor are crucial in determining backscatter information. Whether the seafloor acts as a 
reflector or a scatterer of energy depends on the relative spatial frequencies of the incident 
acoustic signal and the bottom roughness [2,29]. Accordingly, describing bottom roughness 
in terms of spatial frequency is necessary and useful in determining these interactions. The 
determination of high-spatial-frequency seafloor-roughness can be accomplished directly with 
amplitude measurements, however, due to the immense area of the ocean bottom it is 
practically impossible to obtain this information globally. In those cases where such 
measurements have been made, extremely large storage is required for even a small area of 
high-resolution surveys. 

To overcome these limitations some stochastic models have been devised to provide 
the information statistically rather than deterministically. These models use spectral analysis 
to describe the seafloor-roughness in terms of the spatial frequency. The model is based on 
the observation that the power spectral density function of the seafloor profile follows a 
power law [29] and the log-log relationship of power and spatial frequency is linear. 
Verification of these stochastic models has relied on high-frequency sonars for spatial 
frequencies up to lO ' cycles/m and in the very high range of 10^ cycles/m through the use of 
stereo-pair bottom photographs [29]. 

The Crest '91 surveys included high-resolution bathymetric and sidescan sonar surveys 
along with the laser surveys. The sidescan sonars use frequencies of 120 kHz and 200 kHz 
and are capable of measuring spatial frequencies of approximately 10 ' cycles/m and 10® 
cycles/m respectively. The highest resolution sonar used was a Mesotech scanning sonar 
operating at 675 kHz and capable of measuring spatial frequencies into the 10' cycles/m 
range. The laser system's resolution capabilities of less than 10 mm permits the measurement 
of spatial frequencies from 10' to 10^ cycles/m. 
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Current work at the Woods Hole Oceanographic Institution has demonstrated the 
stochastic model for seafloor-roughness using data obtained from Crest '91. Figure 5.9 shows 
the approximate power-law relationship of the power spectral density for several sensors 
employed during Crest '91 . The flattening of the 120-kHz curve near lO' cycles/m is 
attributed to white noise at the limit of the instrument's resolving capability. The highest 
frequencies (10^ cycles/m) were obtained with the laser-ranging system. The following section 
describes power-spectrum determination using laser profiles. 




Figure 5.9: Power-law relationship of the seafloor 
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5.5. Power Spectral Density from Laser Profiles 

An approach to determining power spectral density uses the Fourier transform [30], 
For real data this normally entails computation of the Discrete Fourier Transform (DFT) or 
Fast Fourier Transform (FFT) then conversion to the Discrete Fourier Series (DFS), the 
sampled version of the Fourier Transform [31], In order to consider the DFS a sampled 
version of the data's Fourier transform, the data must have an equal sampling interval for all 
points in the series. The profile points determined by the laser system are not equally spaced 
and in most circumstances there are one or more gaps in a profile. A solution is to select 
profiles meeting a criterion that allows the profiles to be resampled at an equal interval with a 
minimal effect on the representation. Once suitable profiles have been selected and resampled 
they can be processed using the same algorithm applied to the acoustic data. 

5.5.1. Profile Selection and Resampling 

To smooth the results of the power spectral density function, it is desirable to obtain 
several profiles from a homogeneous (stationary) area of the seafloor then average the power 
spectral density for these profiles. To achieve this, data sets with continuous profiling for 
approximately 10 minutes were chosen. At 1 s per profile this yields approximately 600 
profiles per set. Because of the Jason ROV's slow speeds (<1 m/s) it may be assumed the 
seafloor region of each set is homogenous. Six such data sets were found and used for 
power-spectrum computation. Each data set is processed by first omitting any profiles that do 
not contain a minimum number of 128 points; this criterion usually ensures the profile extends 
over an adequate range and does not have significant gaps. The next step is to determine the 
average interval of the profile by dividing total profile length by the number of points. The 
next criterion is to determine if the profile has gaps greater than five times this average 
interval. If a large gap occurs at either end the profile is shortened to remove the gap and the 
criterion reapplied. A profile meeting these requirements is considered suitable for 
resampling. In general, this reduces the number of profiles for a data set to approximately 50. 
This is sensitive to the criteria for minimum profile points and gap size but this number was 
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sufficient for smoothing the power spectral density function. The high standard of these 
criteria also ensures that selected profiles are of high quality and yield good results. 

Resampling uses a linear interpolation between the data points in a profile. To 
compute the average power spectral density function from a group of profiles, each profile 
must have the same sampling interval. If the sampling intervals are not equal, the frequencies 
corresponding to particular points in two separate series are not the same. Having the same 
sampling interval allows the individual power spectral density functions to be combined point 
by point. The sampling interval used is the minimum average interval of the profiles in a data 
set. The profiles are resampled at this interval for 128 points. This causes all the profiles to 
have a new length equal to that of the shortest profile in the data set. Figures 5.10, 5.11, and 
5.12 show original profiles and the profiles resampled using this method (resampled profiles 
are offset for clarity). This method ensures that the profiles are not undersampled and that 
excessively high frequencies are not introduced by the linear interpolation. 




Laser z-axis Ronge (m) 



Figure 5.10; Resampled bottom profile 
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Figure 5.11: Resampled forward profile 




Figure 5.12: Resampled close-range forward profile 
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5.5.2. Power Spectral Density 

The algorithm for determining the normalized power spectral density consists of 
detrending the profiles to remove low-frequency components to concentrate on the 
high-frequency roughness measurement. Profiles are tapered on each end using a split 
Gaussian to reduce aliasing. To determine the power spectral density function, the Fourier 
transform is computed, multiplied by its conjugate, then normalized by the length of the 
profile. 




Spatial Frequency (cycle/m) 



Figure 5.13: Power spectrum of bottom profiles 

Figure 5.13 shows the average power spectral density function for two data sets with a 
down-looking laser configuration. A slightly higher sampling frequency (shorter interval) was 
used with the second data, which led to the high spatial frequencies shown. Figure 5.14 
shows the average power spectral density function for three data sets with the laser in a 
forward-looking configuration. One data set was collected at an extremely close range (see 
Figure 5.12), leading to the very high spatial frequencies seen in this plot. Figure 5.15 shows 
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all six data sets. As a verification of the power-law theory for seafloor-roughness, the power 
spectral density function was computed for one data set from the controlled testing in Chapter 
4. From the results shown in Figure 5. 16 it is clear that the geometric shape of the test tank 
and target do not produce the same results as the seafloor data. 




Figure 5.14; Power spectrum of forward profiles 
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Figure 5.15: Composite power spectrum of laser profiles 
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Figure 5.16: Power spectrum of test tank data 



66 



Chapter 6 

CONCLUSIONS 



6.1. The Practicality of Underwater Optical Ranging 

The drawbacks of traditional acoustic methods for high-resolution measurements in a 
subsea environment have led to the search for alternative techniques. Successful 
implementation of in-air optical techniques for the past three decades and recent developments 
in their employment underwater suggests these methods as a viable option. Three methods of 
laser ranging have potential in the underwater environment; laser radar, wliich uses 
time-of-flight; amplitude-modulation, which employs phase-comparison; and triangulation 
methods. Advantages of laser-ranging systems are the high angular resolutions possible and 
the potentially fast survey rates presented by the high velocity of light. A structured-lighting 
technique using triangulation of a laser plane and a single-camera detection system is chosen 
because of its simplicity and ease of implementation. A general approach in determining 
performance of this technique was undertaken and applied to a commercially available system. 
This system was procured, tested, and applied in an at-sea scientific study to measure seafloor 
roughness in very high-frequency regions (>10^ cycles/m). The system is shown to be a 
feasible and practical option for these very high resolutions (<10 mm). The laser-range 
measurements are used to support the approximate power-law relationship of the seafloor 
power spectral density function and spatial frequency. 

The most restrictive limitation of this system is its sensitivity to lighting. In all cases 
any direct lighting in the system camera's field of view causes complete loss of laser detection. 
Deployment of the system in the deep-sea environment is performed by mounting on an ROV. 
Piloting an ROV in the deep-sea typically involves visual imaging and demands extensive 
lighting. The need to secure this lighting in order to employ the laser ranging system poses 
severe conditions on piloting. Besides risking damage to the vehicle by flying blindly, staying 
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within an acceptable range window is extremely difficult. Corruption of laser profiles due to 
intermittent use of lights while surveying also imposes additional post processing or the need 
for hand editing to cull out this data. For this ranging technique to remain a practicable option 
this limitation must be overcome. 

Although an aim of this study is to evaluate workable alternatives to acoustic methods 
because of limited resolution, the optical technique analyzed still poses a significant problem 
because of limited range. Ranges below 3 m are required to obtain good results. As 
demonstrated by the range-error plot in Figure 4.14, ranges just beyond this have a dramatic 
increase in error. Through observation it is noted that laser detection is lost at approximately 
4 m. Improvements in system range are also essential for most practical applications. 

6.2. Recoimneiidations and Improvements 

The most immediate improvement that could be made to the system studied is to 
develop a method for keeping some ROV lighting energized during laser operation. A 
narrowband filter centered at the laser wavelength might be capable of rejecting enough 
illumination (ideally, without unacceptably decreasing system range) that a low-light-level 
camera with appropriate low-power lighting could be used for vehicle piloting concurrent with 
laser operation. Another alternative is to employ an image subtraction method, where an 
image is obtained with the laser secured then subtracted from the image with the laser line. A 
filter technique could then be applied to the resultant image to further enhance laser detection. 
This would require cycling of the laser, which would reduce useful lifetime but could 
implemented through a mechanical window instead of power interruption. 

Greater range is also essential for most practical applications. Higher laser power, 
receiver sensitivity or both should be implemented to increase laser detection and achieve 
greater ranges. Maintaining ROV position within a 1-m band is difficult especially with ocean 
currents. Increasing the system's dynamic range capability along with the maximum attainable 
range would provide much more workable conditions for ROV deployment of this system. 
Alternative receivers incorporating faster auto-iris, auto-gain, or a combination could be 
implemented in software based on detected laser amplitude values. 
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Improvements in system range-error performance could be made through better 
line-finding algorithms and higher image resolution. Detection of the laser light must be 
followed by refinement to determine only the thin line of the assumed light plane, on which 
system orientation is based. Using an extrema technique instead of thresholding and 
averaging may produce more consistent results and a corresponding increase in performance. 
Reducing pixel size by increasing image resolution reduces the area of object location for a 
given range. This provides a direct and positive improvement on range performance but 
requires increased processing capability. 

Lastly, the system tested has no means of recording the raw video image being 
processed. This option would allow off-line processing of the data that could provide 
valuable improvements in increasing profile density. This poses a timing synchronization 
problem, but a video time-base corrector in conjunction with a good video recorder would 
provide appropriate recording quality. A slight degradation in profile accuracy would be an 
acceptable trade-off to achieve a much higher sampling density. 
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